ON THE LARGEST EIGENVALUE OF PRODUCTS FROM THE 

/3-LAGUERRE ENSEMBLE 



ZACHARY GELBAUM 



Abstract. We determine the limiting distribution of the largest eigenvalue of products 
from the /3-Laguerre ensemble. This limiting distribution is given by a Tracy- Widom law 
with parameter fio > depending on the ratio of the parameters of the two matrices 
involved. 



1. Introduction 

The limiting spectral behavior of products of random matrices has been the subject of 
a number of studies in random matrix theory and various results on the limiting spectral 
distribution of such products are by now known (e.g. [U [2]). In general the spectra 
of such products will be complex, but in the event it is real, e.g., that of the product of 
two Hermitian matrices where one is non- negative definite (see for example [TJ [TO] [3]), 
it makes sense to speak of the largest eigenvalue. There are strong limit laws known 
for these largest eigenvalues, but so far there are no results regarding the distribution of 
the fluctuations around the strong limit. The purpose of this paper is to investigate this 
limiting distribution in the setting the /3-Laguerre ensembles. 

The /3-Laguerre ensemble generalizes the classical Laguerre ensemble by allowing f3 to 
vary over the positive reals in 

n g 

(i-i) < K U^-^U x t~ n+iyi ^ x ^ 

i<j k=l 

where without loss of generality k > n and K is a normalizing constant (see e.g. [6]). 
The above densities first arose in the study of certain quantum systems and orthogonal 
polynomials (see [6] and references therein), however there were initially no known random 
matrices with these eigenvalue densities. Then in [5] the authors constructed families of 
tridiagonal random matrices whos eigenvalue densities agreed with the above, and in [9] 
the limiting distribution of the largest eigenvalues was determined, thus generalizing the 
classical Tracy- Widom laws for (5 = 1,2, 4 to a family of distributions indexed by (3 > 0, 
denoted TWp. 

In a first approach to the general problem of finding the limiting distribution of the 
largest eigenvalue of a product of random matrices, we are free to choose which matrix 
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ensemble to work with and the /3-ensembles along the methods employed in [9] are partic- 
ularly amenable to such a study (the reader may note that throughout this paper we make 
the slight abuse of language in referring to both the above density and the corresponding 
family of random matrices as the /3-Laguerre ensemble). Our results are as follows: 

Theorem 1.1. Let X% and X^ be two independent elements of the (3-Laguerre ensemble, 
with k = p and q respectively. Assume that n < p < q and that p = 0(n) = q. Then if \ n ,o 
is the largest eigenvalue of X^X^, 

A n ,0-/^ 4 rWft; 
where TWp denotes the Tracy- Widom Law with parameter /3q and 



f3 = lim C n /3, pL n = (v / ^ + v / P) 2 (v / ™ + Vq) 2 , 




the constants C n and c n being defined by \2. 7| ) and \2. 8\) in section 2.4 below. 

We have written the scaling terms to ease comparison to the case of a single matrix (e.g. 
[9], Theorem 1.4), noting that c n — > c £ R by the hypothesis p = 0(q). It is worth noting 
that if both matrices are identically distributed, i.e. p = q, then C n = 2, so even in the i.i.d. 
case the parameter of the limiting Tracy- Widom law is different than that of the factors. 

In [9] the authors show how elements of the /3-Laguerre ensembles can be realized as 
finite difference approximations to a stochastic differential operator on [0, oo). Just as in 
the usual finite difference schemes, e.g., for the Laplacian on [0, oo), the lowest k eigenvalues 
and eigenvectors converge to those of the limiting operator. This characterization of the 
limiting distributions is robust and we make full use of the results and techniques in [9] 
below, in particular section 5 in that paper. We note here that although we assume in 
Theroem 1.1 that n < p < q, this is only to simplify the proof; one can relabel parameters 
without altering the arguments in any essential way. 

In the next section we outline the setup from [9] and then proceed to the proof of 
Theorem 1.1. We end with some remarks and further questions in section 3. 



2. Proof of Theorem 1.1 

2.1. Tridiagonal elements of the /3-Laguerre ensemble. Here we briefly describe the 
tridiagonal matrix ensemble that realizes (1.1); for proofs and further discussion see [5] and 
[6] . Let Xa denote the random variable with density 
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said to be a chi random variable with parameter a. Let B%, k > n be the following matrix: 



TDK 



X0(n-l) X0(k-l) 



Xf3 Xp(K-n+l)_ 

where Xa an d Xa denote independent chi random variables. Then the eigenvalues of 

XK ( DK"1* TDK 

have density (1.1). Note that X% has 

~2 i 2 

Xp( K -j+l) + X/3( n -j) 

along the main diagonal, j = 1, . . . , n, and 

Xp(K-j)X/3(n-j) 

above and below the main diagonal. 

2.2. Notation and Setup from [9]. Unless specified otherwise, for vectors v,u G M. n , 
(v,u) denotes the Euclidean inner product and likewise for ||i>||. 
Fix f3 > and let XI, i = p,q, be as above. Define 



m 



fJ"n,p X n 



(7 



n .p 



'ni 



n + yi 



Hn,i = (Vn + Vi) 2 , 



m 



i 



Or, 



a 



n,q 



1 + 



{yjn + \fi)t 



^ni) 3 



Note here that the X l n , and hence the H l n , are independent, a fact we will use repeatedly 
below. 

Let L* be the following subspace of L 2 , 

L* = {/GL 2 [0,oo): /(0) = 0, < oo} 



where 



/ (ff + xf + fdx. 
Jo 



Let B be standard Brownian motion on [0, oo) and for f £ L* define 
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where B f is the distribution given by 

4 Cub 



dt ... 

and where we denote the action of Haf on a test function <j) G by 
Thus if is a test function, 

(B'f,cf>) = -(f , B,cf>)-(fB,<j>'). 

In [S] it is shown that (g,H»f) defines a continuous bilinear form on L* and if A denotes 
the smallest eigenvalue of Hp, given by 

(2.1) A = inf{(/, f € L\ ||/|| i2 = 1}, 

then —A is distributed as TWp: — A ~ TWp. 

Next let L* j be the subspace of L 2 [0, oo) consisting of step functions of the following 
form: 

n 

f = X] Cfc X[-^-,-M- 

, ^ m n,i m n,i 

k=l 

Let P n be the projection from L 2 onto this subspace. Then L* ^ is isometric to R n with 
the inner product 



m n}t( V ' U ) = m n}Yl 



VkUk, 



k=l 

n 

fc=l 

We let T n denote the shift operator 

that is, the operator given by the nxn matrix with l's below the main diagonal and zero's 
elsewhere. Then define the difference operator 

A l n v k = m n)i (v k - v k -i) = m nji (I - T*)v k , 

i. e., for (f> G C£° A^A"P n — > <f>" in L 2 , and note ||T n || = 1. Additionally, for two vectors 

ii, t; G R" we denote by u x v the vector 

. . -,u n v n ). 

H l n now takes the following form: 

Hiv = - A^A> + {AW nA ) x v + \ (A^ 2 ) x T n v + ir* (A^ >2 ) x v, 



A 1 v' 1 ■ = rf ■ + A' 1 w l ■ 

nanj inj 1 n n,]) 
1 1 

j ii . Tn 
= -p±(n + i - /3 _1 IE[x^(i-fc+i) + X?(„- fc) ]) = -^4(2* - 1) 



ni vni 
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,2 



(jln,2)k = —!=2{Vni - (3 l E[xp(n-k)Xp(i-k)]), 
^ E (n + • - p-Hxl-j + xl j+1 )) ~ m-^), 

A; 



/ i \ m 



We now collect some bounds we will need in the proof below. In |9j it is shown that 
for each i and any subsequence H^ m there exists a further subsequence and a probability 
space such that the statements below hold almost surely and from now on we will assume 
we are working with such a subsequence. 

First we have that for any e > there is a c* > such that 



(2-2) \K<j,k\< ™n,i^V l njk + 4 

where 

~i _ k 

Next we have the following two bounds 

(2-3) Vn,j, k < 2"<i, c\ff < rf nXk + rf n ^ k < c^' 1 

for some c\ > 0. Finally (cf section 6 in [9]), there exist independent Brownian motions 
B l and processes such that 

(2-4) Vn,j{x) = (y^)L*mn,,jl«mn,,e[0,n] -> 

and 

2/n,l(^)+<2(^) -> + y 

in the Skorokhod topology on D[0, oo). 

2.3. Outline of the proof. Let Hp denote the operator Hp above with B l in place of B. 
In [9] the authors show, for each subsequence restricted to a further subsequence such that 
the above bounds hold a.s., that the smallest eigenvalue and corresponding eigenvector of 
H % n converge to that of Hg using three Lemmas, numbered 5.6 — 5.8, the content of which 
is as follows: Lemma 5.6 states that there are positive constants c k independent of n such 
that for all v £R n 

CilMlL* - C2"VilMII < m-)(H^v,v)Rn < c\\\v\\l M 



where 



i 

Hln* = m n.i(ll A n y llR« + IKOx^IIr™ + IMll' 
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This is a coercivity bound used to control the eigenvectors as n — > oo. Lemma 5.7 estab- 
lishes convergence in the sense of distributions, i.e., if /„ G L* ni is such that / n — >• / and 
A l n f n ->• /' weakly in L 2 then for any <j) £ 

Lastly Lemma 5.8 ensures that the eigenvectors of contain a subsequence converging to 
those of IP: If / n G i^tJ < c < oo, and ||/||^2 = 1 then there exists a subsequence 

/ nfe such that f nk ^ L 2 f eL* and (cf), H z nk f nk ) L 2 -> for all G C c °°. 

We want to study the smallest eigenvalue of 

jj ^"a,p^n,ql -^-n-^-n f^n,pl -^-n -^-n f^n,p Hn,ql X n 

n 2 2 2 2" 

<J n,p (7 n,q a n,p <J n,q a n,p a n,p a n,q a n,q 

= -p*-m! - —H q n ) + -!r*-K 

a n,q ,J n,p ^n,q a n,p C 'n,<l 

2 2 

-a H p + b H q - m "' p?7ln ' g HPH q 

^TT'n ( ^n,p ( ^n,q 



where 



and 



m 2 / ( ITT-n v + _a ~J W„ _ ) m n p m n q 

n,q n iV n,p "-jy 



2 2 
m n,pl- l 'n,q , m n,qL L n,p 



9 9 ' At 9 9 



°n u n,q u n,p " b n u n,p u n,q 

This choice of m n ensures the proper scaling for the convergence we need below. 

In the next section we determine the limiting operator of H n in the sense above. The 
product term H^H^ prevents us from directly applying Theorem 5.1 in [9], so instead we 
will follow the proof of that Theorem, stating and proving Lemmas analogous to those 
above. 

2.4. Convergence. To begin we first establish analogous almost sure bounds to those 
above. We have 

B*v = -A n A* n v + (Anj&J x v + - (A n ^ )2 ) x T n v + X -T* n (A n y^ 2 ) x v 

where 

A„ = m n (I - T*), 
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i.e., 



1 

Noting that by hypothesis 



1=1 ' 



m n = 0(m n>p ) = 0{m n>q ) = 0(n 1/3 ), 
it follows easily from (2.2) and (2.3) that we can reduce to subsequences as above such that 
(2.5) \(f± n w % n j) k \ < m n ^efj n>k + c e , 

(2-6) ff n ,j,k < 2r n 2 n , c[r\ < ff n ^ k + ff n 2 k < (%fj, 

and the processes defined by 

Vn,j( x ) — \Snj) [xm n ] ^-xm n £[0,n] 

are convergent in the Skorokhod topology on D[0,oo), where f] n ^ = k/m n and we reuse 
the notation for the constants from above, though they may be different here. With the 
bounds (2.5)-(2.6) in hand, the proofs of Lemmas 5.6-5.8 in [9] apply without change to 
H^, a fact we will use below. 

If we now let y n j = — y v n - + — y q nj where 

(2.7) c n -a n + b n - (V^+VP) 4 (V^+^ 

then by our choice of m n and using the independence of the y\ it follows from [9], section 
6, that there is a Brownian motion B x such that 

x 2 2 

Vn,l{x) + y n>2 (x) -> y + -j{Jfi B V 

(2.8) C =lu a (^i + ^%y 1 = l +] im P(^ + VP) 2 + ^ + ^) 2 



n^oo \m^ p c,2 ml q c 2 n J n-too ^/pq ((^/n + ,/p) 2 + (v 7 ^ + y/q) 2 ) ' 

in law with respect to the Skorokhod topology on D[0, 00). As already noted, we can reduce 
to a further subsequence such that this convergence holds almost surely on some probability 
space. We now have a candidate limiting operator: 

( d 2 2 \ 

H n -> c I —j~2 + %+ ~^Jjjjl B 'x) = cH Poi ^0 = C/3, c = limc n , 

the idea being that c~ l {a n H^ + b n H q ) — > Hp and the product term H^H q vanishes in the 
limit. 
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In the following Lemma we let L* be the analogue of the discrete spaces already defined 
above for our new scaling term, e.g., L* is the space of step functions of the form 

n 



k=l 



and P n denotes the projection from L 2 onto this space. 
Lemma 2.1. Let f n £ L* be such that f n — > f and A n f n — > f' weakly in L 2 . Then for all 

(4>,H n f n ) L 2 = (P n (f),H n f n ) L 2 -> ((j),cHp f). 

Proof. The bounds (2.5)-(2.6) can be extended additively to a n H^ + b n H^ and the proof 
of Lemma 5.7 in [9j goes through without change to show that under the hypotheses above 

(2.9) (</>, (a n HP + b n Hl)f n ) L 2 -> (<f>,cHp f). 

Next, 

< P < 9 ^Q(m- 2 ), 



so the proof of Lemma 2.1 reduces to showing 

m- 2 (4>, H*H*f n )v = m- 2 (HPp n 4>, -A n A*J n ) L 2 + m" 2 ^^, H*f n + A n A*J n ) L 2 -> 0. 
First note that for g £ L 2 , T n g — > g in L 2 and likewise for T*. Then 

{g,T n f n ) L 2 = (T*g,f n ) L 2 -> (g,f) L 2 
so T n / n — > f weakly and likewise for T*f n . Similarly T n T*f n — > f weakly. Thus 

(T*-I)(I-T n )f n ^0 

weakly. Next observe that 

(g, A n (T* -/)(/- T n )f n ) = (g, (I - T* n ){T n - I)A*J n ) = ((T* -/)(/- T n )g, A*J n ) 
and (T* — I) (I — T n )g — > in L 2 . We also have A* n f n —>•—/' weakly. Thus 

A n (T n *-/)(/-T n )/ n ^0 
weakly as well and Lemma 5.7 now implies 

m- 2 (^P n 0, -A n A;/ n ) i2 = <0,i?£(T* - J)(J - T n )f n ) L 2 -> 0. 
For the terms 

{m- 2 HPP n <t>, H«f n + A n A*J n ) L 2 
we note that from the proof of Lemma 5.7 in [9] we have the following: If g n S L* is such 
that g n is bounded both uniformly independent of n, g n and A n g n both have supports that 
are contained in a finite interval / for all n, and both are convergent in L 2 with 

L 2 L 2 

g n ^t g and A n g n -)■ p , 

then 

<<?n, H*f n + A n A* n f n ) L 2 -> ( 5) #«/ + /") 
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for all f n as above. Thus if we show that g n = m~ 2 H^P n (f) satisfies the above hypothesis 
and g n — > the proof will be complete. 

The existence of / comes from eft £ and uniform boundedness follows easily from 
(|2.5p and (|2.6p together with the compact support and uniform boundedness of P n (j). 

To control 

we first consider A n (— m~ 2 A n A*P n 0) = (J — T*)(T* — I)A*P„0. By the arguments above 
this converges to in L 2 . For the potential term 



(2.10) 




we note that y^-{x) are locally bounded and convergent a.e. This combined with the 
compact support of P n (p implies the Vnj( x ) converge locally in L 2 , and by the arguments 

above regarding T n we find that the above converges to in I? . That m~ 2 H^P n 4> ^> 
follows similarly. 

□ 

Lemma 2.2. Define the following norm on M. n : 

i 

IMlL = "^n 1 (ll A n'w|||« + \\(Vn)x v \\l" + IMll™)- 

Then we have constants Cf. > and N > such that for all n> N 

_i 

(2.11) CilMIn* - C 2 m n 2 lkl|ffi»vlNl* _ C 3 m^ 1 \\v\\ 2 l n < (H n v,v) L 2. 

Proof. We have by definition 




= A*v + B l v + CV 



So letting 
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we have 



2 2 

a n (HPv,v) + b n (H«v,v) - "V*> m "« (H*v,H*v) 



"n,p" n,q 

(2.12) = a n (((AP + B P )(I - dnd-^A* + B q ))v, v)) + b n ((A q + B<)v, v) 

(2.13) + d n ((C q v, (A p + B p )v) + (C p v, (A* + B q )v) + (C q v, C p v)) 

+ a n (C p v,v) + b n (C q v,v). 

We first bound (2.13) and then (2.12). We have from (£3} 

(2.14) m~ l \\l^w ntjjk v k \\ < \\^efi ntk + c € v k \\. 
Then for m~ 2 (<O q v,C p v) we have 

m- l \\C l v\\ < \\\fefhhk + c e v k \\ + ]^\\A l n w l nflyk T n v k \\ + ^\\T*A l n w l n ^ k v k \\ 

= \\y/erjn,k + CeVk\\ + ^11 A nK,2,k v k+l\\ + \\\ T n A nWn,2,kVk\\ 
1„ , 1, 



< \\y/erjn,k + CeV k \\ + -|| y^fc + c e t; fc+ i|| + -\\T*A l n w l n2:k v k \\ 

< W e Vn,k + c e v k \\ + -|| v / e^fe+l +c e v k+ i\\ + \ \\\ferjn,k-i + c e v k 



< 2\W ef in,k + C € V k \\ 



and so 



2 



|w£ 2 (C7 9 t;,Ci;)| < 411^^ + ^11 2 = 4e|| v / ^v fc || 2 + c e ||i;| 
(2.15) < Aem n \\v\\l n + c e \\v\\^„. 

For the {A, C) terms, 

m-^vW = c^lKJ - T* n )A* n v\\ < 2c*||A n t,|| 
for constants c l > 0, so we have 

m^ll^ll < CA||A n u|| 

for some c A > 0. Thus 



m- 2 \(C q v,A p v}\ < 2\\^efin,k + c € v k \\c A \\A n v\ 



< 2c A {\J emnlHI 2 ^ + v^lkll) V^rilM 



(2.16) = 2c A yyim n \\v\\^ + v^lMk"V^ 

and similarly for m~ 2 (A q v,C p v). 
For the (B, C) terms note that 



' ^nll^H 2 * ) j 



n 2 \{A n w % nd ) k \ < m n 1 y r e^+~c e < y/eyj mj 'fj + m m ] g ^ < ciy/e + m^y/ 



ON THE LARGEST EIGENVALUE OF PRODUCTS FROM THE /3-LAGUERRE ENSEMBLE 11 

By Cauchy-Schwarz and (|2.6p we have 

\m- 2 (C%,BPv)\ < C2(Q^+m^^(i)^ 

(2.17) < c 3 (ci^ + m^ 1 ^/cl)m n \\v\\ 2 nif 

and likewise for m~ 2 (C p v,B q v). 

For the remaining noise terms, we have from the proof of Lemma 5.6 in [9 J that 

(C l v,v) > -c A yfem n \\v\\ 2 nif - c 5 (e)|H||„. 

For (2.11), first we note that arguing as in [9j using (12. 6p we have 

{(A p + B p )v,v) > 0. 

After some algebra we find 

fg 

d n V n _ 2 1 _o 

-m n < -m n . 



By definition, 

m- 2 ((AP + B>, «) = ^(m- 2 ^), - 2)^ + m - 2 (rf n 2 ) k + 2) TO+1 
< 4\\v\\ 2 

using (|2.6p and Cauchy-Schwarz. Thus 

c^a" 1 ^ + < \\v\\ 2 

and so 

/ — d n a~ 1 (A p + B p ) 
is Hermitian with spectrum contained in [0, 1]. Thus 

T = (A p + B P )(I — d n a~ 1 (A p + -B p )), 

being the product of two Hermitian, nonnegative matrices has only real, nonnegative eigen- 
values (though it need not be normal). Then using standard results (see e.g. [7], chapter 1 
and |11| ) on the numerical range of T, 

{(Tv,v) : \\v\\ = 1}, 

we see that (Tv,v) > — \\v\\ 2 . Thus 

(2.18) {{ A p + B p )(I-d n a- 1 (A p + B p ))v,v}>-\\v\\ 2 Rn . 

Lastly, from [9], Lemma 5.6, we know 

((A q + B q )v,v) > cem n \\vf w - c 7 \\v\\ 2 . 
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Noting that a n , b n , and d n are convergent, we now have constants c%, eg, cio(e), cn(e), 012(e) > 
such that 

(2.19) a n {HP V , v) + bniH^v, v) - d n (H p n v, H q n v) 

> (c 8 - c 9 0(e) - ci (e)m~ 1 )m n ||v||^ - cn(e)||u[| V^nlHIL ~ ci 2 (e)||w|| 2 
where 0(e) — > as e — > 0. Taking e small and then n large establishes the Lemma. □ 
Lemma 2.3. Suppose f n G L* mi/i ||/ n ||*n < c < 00 and H/nlli 2 = 1- TTien f/iere exists 

L 2 

f G L* and a subsequence f nk such that f Uk — > f and for all <p G C£° we /ia?/e 

{<P,H n J nk ) L 2 ->• (</>,cHp f). 
Proof. The proof is that same as that of Lemma 5.8 in [9] and we omit it. □ 

Let A n; o and -u n ,o be the smallest eigenvalue and corresponding eigenvector of H n such 
that || f n.,0 II 2,2 = ll w n,o IIr« = 1; an d let Ao and /o be the same for i?g . To show that 
A n ,o - 51 cAo we can proceed exactly as in [9], repeating the arguments for completeness. 

Suppose liminf A nj o < 00. Lemma 2.2 shows that A nj o is uniformly bounded below 
so there exists a subsequence such that A nfei o — > liminf A n o- Lemma 2.2 now implies 
that ||«nk,o||n* are uniformly bounded, Lemma 2.3 then implies that a further subsequence 
converges to some / G L* as in Lemma 2.1, and so Lemma 2.1 implies that for this further 
subsequence 

(P n <p, H nk v nkfi ) L 2 -)• (<f>,cHp f). 



Then it follows that 



for all 4> G C°°. Thus 



- liminf Ano-^'^ 



</,/>£» '(/,/) 



L 2 



c 

liminf A„ 5 o > cAo- 

To see limsup A nj o < cAq, let f e G be such that \\f e — /oil* < e. Then by the minmax 
principle and Lemma 2.1, 

fn orv\ i • \ ^ i- (Pnf e ,HnPnf/L 2 

(2.20) lim sup A nj0 < hm sup ——7-— 

n->oo {P n f t ,P n f t ) L 2 
(f e J e )L 2 ' 

Letting e — >• we have 

limsupA n) o < —77, — ft = cA . 

UOi 7o/l 2 

Noting that by definition 

An,0 — 



~A n ,0 — c n" 



0~r, 
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what we have then is that for every subsequence of {A ni o} there exists a probability space 
and a further subsequence along which 



almost surely. Recalling that — Aq ~ TWp , Theorem 1.1 obtains. 



3. Some remarks 

The reader may note that contrary to the approach in the classical case, the framework 
in terms of a limiting operator allows us to avoid determining the eigenvalue densities for 
finite n, which, depending on one's point of view can be either an advantage or disadvantage 
to the approach. 

Although Theorem 1.1 does not tell us about the largest eigenvalue of the product of 
two independent Wishart matrices, it does suggest some interesting questions regarding 
the classical ensembles. For example, in [3] the authors determine the limiting empirical 
spectral distribution for a product of independent Wisharts, the limit depending on the 
ratio of the two parameters in the product. The authors there conjecture that the limiting 
distribution of the largest eigenvalue of such a product is a Tracy- Widom law. One can 
then ask the following: If the limit does indeed follow a Tracy- Widom law TWp, what is 
j3, and does it depend on the parameters in a way similar to that in Theorem 1.1? Much 
is still unknown about the full family of TWr distributions and it would be of interest to 
see them arise for j3 ^ 1, 2, 4 in the context of the classical ensembles. 
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